Computational Techniques for Investigating Information Theoretic Limits of Information Systems
نویسندگان
چکیده
Computer-aided methods, based on the entropic linear program framework, have been shown to be effective in assisting study of information theoretic fundamental limits systems. One key element that significantly impacts their computation efficiency and applicability is reduction variables, problem-specific symmetry dependence relations. In this work, we propose using disjoint-set data structure algorithmically identify mapping, instead relying exhaustive enumeration equivalence classification. Based reduced program, consider four techniques investigate systems: (1) computing an outer bound for a given combination measures providing values at optimal solution; (2) efficiently polytope tradeoff between two quantities; (3) producing proof (as weighted sum known inequalities) computed bound; (4) range quantities which value does not change, i.e., sensitivity analysis. A toolbox, with efficient JSON format input frontend, either Gurobi or Cplex as solving engine, implemented open-sourced.
منابع مشابه
Information-Theoretic Computational Complexity
This paper attempts to describe, in nontechnical language, some of the concepts and methods of one school of thought regarding computational complexity. It applies the viewpoint of information theory to computers. This will first lead us to a definition of the degree of randomness of individual binary strings, and then to an information-theoretic version of Gödel's theorem on the limitations of...
متن کاملInformation - Theoretic Limits for Density Estimation
This paper is concerned with the information-theoretical limits of density estimation for Gaussian random variables with data drawn independently and with identical distributions. We apply Fano’s inequality to the space of densities and an arbitrary estimator. We derive necessary conditions on the sample size for reliable density recovery and for reliable density estimation. These conditions ar...
متن کاملA New Method for Improving Computational Cost of Open Information Extraction Systems Using Log-Linear Model
Information extraction (IE) is a process of automatically providing a structured representation from an unstructured or semi-structured text. It is a long-standing challenge in natural language processing (NLP) which has been intensified by the increased volume of information and heterogeneity, and non-structured form of it. One of the core information extraction tasks is relation extraction wh...
متن کاملInformation Integration using Information Theoretic Techniques
The problem of data and information integration is widespread and growing in government and industry, and it is getting worse as legacy systems continue to appear. The absence of efficient large-scale practical solutions to the problem, and the promise of especially the information theoretic techniques on comparing sets of data values, make this an extremely rewarding and potentially high-payof...
متن کاملInformation-Theoretic Capacity Limits in Multi-cell Joint Processing Systems
Multicell Joint Processing has emerged as a new paradigm of cooperative communications , which aims at pushing the capacity limits of cellular systems by eliminating inter-cell interference. Its operation is based on the concept of Base Station cooperation , which is enabled through wideband error-free low-latency links to a central signal processor. This processor is responsible for jointly en...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Information
سال: 2021
ISSN: ['2078-2489']
DOI: https://doi.org/10.3390/info12020082